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ABSTBACT 
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'discussed; nuabers and nuaeration; .variables and relationships; 
shape, size, and position; aeasureaent; probability and statistics; 
and technology- Technology is aeasured by assessing the use of 
calculators and coaputer literacy- Five categories in the process 
doaain are reviewed; knowledge, skill, understanding, application and 
•problea sol/ing-, and attitudes towards aatheaatics- Questions to be 
answered within each of the process categories are listed- Ihe first 
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The second provides additional inforaation on three assessaent 
topics; attitudes, the calculator., and estiaation skills. (MP) 



-l^** Beproductions supplied by EDBS are the best that can be aade « * 
* ' froa the original docuaent- * 



MATHEMATICS OBJECTIVES 
1981-82 Assessment 



No. 13-MA-10 



U.S. DEPARTMENT OF EDUCATION 
NATIONAL INSTITUTE OF EDUCATION ' 
EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 
y^Ttus document has been reproduced a* 
received f*om the person or organization 
originating it. 
Zl Mmof changes have been made to improve 
reproduction quality. 

• Pomts of vtew or opinions stated m this docu- 
ment do not necessarily represent official NIE 
position or policy 



by the 

National Assessment of Educational Progress 

Education Commission of the States 
Suite 700, i860 Lincoln Street 
Denver, Cplorado 80295 



No. 13-MA-10 



The~Natk>nal Assessment of £ducational Progress is funded 
^r, , by, the National Institute of Education. It is under contract with 

£ " * the^Education Commission of the States. It is the .policy of the 

k t v- Education Commission of the States to take affirmative action 

>'^7ir/ to prevent discrimination in its policies, programs and employ- 

meht practices. 



Library of Congress 
Catalog Card Number: 72-169008 ' 



Although objectives booklet* produced by the National Assessment of Educational 
Progress between 1969 and 1972 ha\e their own individual catalog card numbers, the 
number abou- is a series number assigned to all National Assessment objectives booklets 
published since then. 1 



ISBN O-89398-147-8 



National Assessment of Educational Progress, S981 

The National Assessment of Educational Progress is an education rest arch project mandated b) Congress to 
collect and a port data, oxer tinu, on thi performance of )oung Americans, in \arious learning areas. National 
Assessment mako available information on assessment procedures and materials to state and local education 
agencies and others. *» 

Tru work upon which this publication is based was performed pursuant to Gra.pt No. Nlk-G-80-0003 of the „ 
National Institute of Education. It does not, however, ncxcssaril) reflect the Mews of that agency. 



- » **** 




<•- • » ■** * j " " V* 



I 



£jf Sift* - 

ifv TABLE OF CONTENTS 

■ ■ .! 
l^f ^LISTpF FIGURES v 

^ : - JEHAPTER i the First Assessment of Mathematics 

t&T ,0972-73) V - ■ -V ■ * » 

: .CHAPTER 2 The Second Assessment of Mathematics , 

(1977-78) I * 

Assessment Results and Reports . 7 

* CHAPTER 3 The Third Assessment of Mathematics * 

(1981-82) > n ? 

* * Content ^ . . . » / p . . 9 

- Calculator 12 

J*' Computer Literacy * n 

: Process 13 

\ Questions To Be Answ ered by the Assessment >6 

APPENDIX A Consultants for Development 19 

Advisor)' Committee Members 19 

Consultants : 19 

V „ « 

$H APPENDIX B Details of Objectives for the 

Third Mathematics Assessment 23 

rt f -... Attitudes - 23 

; Calculator ~ 28 

Estimation , 29 

APPENDIX eContent Outline . . .. 33 

|v ' ;list of references 3? 



IERJC . 



JU^y-'-'y * ' ' * LIST OF FIGURES 



** o-vV Assessment : • 6 . "J 



KA"- - - 

* ?FIGURE ; 2: Objectives Framework for the Third 



- i Assessment ' i o 



; #IGUREx3. Percentages of Exercises by Age and 
kr % Content ; f 3 



1ft" 



^r/.X jFIGUBE \\ Percentages of Exercises by Age and 

> Process Level ! 4 



6< - 



9 



... ^tv% 



CHAPTER i 

THE FIRST ASSESSMENT 
OF MATHEMATICS (1972-73) 

The National Assessment of Educational Piwnvss conducted the first assessment of mathe- 

O 

.matics during the 1972-73 school. year. The objectives for that assessment were developed 
by two educational testing contractors. Educational Testing Sen ice 'and Psychological Cor- 
poration. Each contractor independently developed a set of objectives, relying on its staff, 
mathematicians and mathematics educators. The final sets of objectives were reviewed by 
panels of interested lay citizens to decide which set to use in the assessment. Panel mem- 

,bers were evenlv divided in their preference for the two sets of objectives. In the absence 
_ ofa strong preference, the Psychological Corporation was asked to continue the develop- 
ment of objectives, and in 1968, completed its revision ofthe objectives. The revision, to- 
gether with objectives selected from the Educational Testing Services version, was com- 
piled ; nto a final statement of objectives for the first assessment of mathematics. A booklet 
containing the statement w as published in 1970. 

When the objectives for mathematics were first formulated, the) were compared with 
other statements of objectives that had appeared in mathematics education literature dur- 
ing the preceding 2$ years. The objectives for the first assessment were consistent with ob- 
jectives appearing in the literature. This outcome was both desired and expected sincc^pne 
criterion for the National Assessment objectives was that they be' central to prevailing 
teaching efforts. 

A three-dimensional classification scheme was used to categorize the mathematics objec- 
tives for the first assessment. One dimension of the scheme was "Uses of Mathematics," 
which was divided into three major categories: 

1. Social mathematics (the mathematics needed for persona! living and effective uti- 
zeaship in our society). t 

2. Technical mathematics (the mathematics necessary for various skilled jobs and 
professions). v 

3» r Academic mathematics (the formally structured mathematics that provide the basis 
for an understanding of various mathematical processes). 



11 










: 


y Another dimension of the matrix was "Content.' 1 The content areas were: 
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Numbers and numeration concepts. 
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Properties of numbers and operations. 










. .Arithmetic computations* 
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Sets: " 




v'1 


%"? " 




— Estimations nd measurements ! . _ 








6. 


Exponents and logarithms. 
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Algebraic expressions. 




ft 
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5 ; s. 


Equations and inequalities. 
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9- 


Rmctions. 




1 
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Probability and statistics. 




1 "5, 




-; -II. 


Geometry. 
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" 12. 


Trigonometry. 
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Mathematical proof. ^ « 
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Logic. 
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^ »t . 




Miscellaneous topics. 
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Business and consumer mathematics. ^ 










Attitude and interest. 
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The. third dimension of tht classification scheme consisted of six cognitive. 


"'Objectives or 




>f - 


Abilities": 






i * 


2. 


To a*call and/or recognize definitions, facts and symbols. 
To perform mathematical manipulations. 
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To understand mathematical concepts. 
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To solve mathematical problems — social, technical and academic. 
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To use mathematics and mathematical rvasonihg to analyze problem situations, de- 
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fine problems, formulate hypotheses, make decisions and verify result* 




,; 




6. 


To appreciate and use mathematics. 








» * 

During the development and rtxiew of the exercises, the content and ability 


dimensions of 


\ 




, the 


classification scheme were the most useful. The exorcist developers tended not to use 






the 


first dimtnsion, uses of mathematics, when classify ing exeaises. This first dimension 
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tended to post too man) restrictions on txercise dtulopment to makt its use worthwhile. 
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'Although the exeaises were classified by content and ability* not all content areas or abili- 
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f{ 


ties were assessed equal!). Certain content topics were purposely measurvd 


in more detail 
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than others. Furthermore, cun though the objectives werv Intended to 


ntlude all the 


\i 


y~ , - 
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mathematics taught in the nation's schools, it was impossible to measurv eu 


ry objective in 




depth. Little emphasis, for example, was placed on the topics of trigonometry and logic. 


Tht 


content arva of "attitude and interest" and the related ability of "apprvciation and use 




*^ 


0 * 7 
ERLC * 




• . 1 
>* 

"i 











oTmathcmatic ( s* were not measured because the exercises developed to assess these wem 
considered inadequate. * 

** < 

Approximately half of the exercises used in the mathematics assessment were released to 
the public. These exercises were included in various mathematics repojts and made avail- 
able to individuals, groups and states for their own uses. The unreleased exercises were 
used again in the second assessment of mathematics to measure changes in educational at- 
tainments. A general surve) of the results of the firsts mathematic s assessment is provided 
in The First National Assessment of Mathethatics. An Overview (1975).' The text of each released 
exercise and accompanying documentation including results can be found in theMathemat- 
jcs Technical Report. Exercise Volume (197)*. Data are provided for all of the mathematics exer- 
cises, but the exact text and scoring guides are provided for the released exercises only. 

Results concerning computational abilities oPyoung Americans are presented and dis- 
cussed in a special report, Math Fundamentals. Selected Results From the First Sational Assessment 
of Mathematics (1975). The results concerning consumei mathematics are presented and dis- 
cussed in Consumer Math. Selected Results From the Fjrst National Assessment of Mathematics 
(1975). In addition, National Assessment has produced computer data tapes containing re- 
spondent-level data for the exercises that were reassessed in 1977-78. These daU tapes are 
available to anv researcher who wishes to conduct further analysis of the data. 2 

National Assessment has worked closely with a panel of mathematics educators from the 
National Council of Teachers of Mathematics (NCTM), who studied the data in order to 
draw implications from the results of the first mathematics assessment. The NCTM panel 
presented summaries of its findings in the October 1975 issues of fhc^Arithmctn Teaiher and 
The Mathematics Teacher. Additional brief articles on specific content topics were presented 
in the October 1975 through May .976 issue's of The Arithmetic Teacher. The'se articles sug- 
gest some of the ways mathematics teachers might usi information from the first assess- 
ment to improve teaching. References for these articles are found in the section at the back 
of this booklet entitled "List of References." 



'National Assessment n ports tan bt urdired thn>ugh thi Surnnntindint of Douimmts, U.S Gmrnment 
Printing Offki» Washington, D.C. 20402 or thi National Assessment of Ldiuattonal Progress, Sum 700, 1880 
Lincoln Street, Diwer, Colorado 8029$. 

l Data tapes arv a\ai!ab!i , at 1 ihargt , through thi Department of Us<r St riiies, National Assxssmmt of Educa- 
tional Progress, Suite 700, i860 Lincoln Street, Demer, Colorado 80295. 
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CHAPTER 2 

THE SECOND ASSESSMENT 
OF MATHEMATICS (.1977-78) 



Unlike the first assessment, which made use of outside contractors, the object i\es and ex- 
ercises for the second assessment were de\ eloped through conferences organized b) the 
National Assessment of Educational Progress. The conference procedure was intended to, 
give the assessment greater flexibility in\olu more professionals in mathematics and edu- 
. cation and be* more efficient in cost and time. 

Several t\pes of consultants participated in the developmental conferences, college or uni- 
versity mathematics educators, mathematicians, classroom teachers and interested la> citi- 
zens. The objectives had to be acceptable to these groups. The mathematics experts gener- 
ally had to agree that the objective's were worthwhile and important to assess. The 
, classroom teachers had to consider the objection's to be desirable teaching goals in most 
schools. Finall), the object iu\s had to l>e considered desirable b) the la) citi/ens. The- la) 
group, including parents and others with an interest in education, had to agree that an ob- 
jective be important for Americas \outh to achie\e aind that it be of value in todaj s 
society. 

The .objectives vvi re organized into a content-In -process matrix (see Figure i ). This matrix 
resembles the classification scheme developed fejr the first assessment and was used exten- 
sively in the developmental process. Fewer, but more inclusive, content and process head- 
ings in the matrix for the second assessment resulted in fewer cells. The complicated task 
of exercise development was sulxlivided into units corasponding to the cells of the matrix. 
The cells were weighted in projxjrlion to their im|x>rtance. The numlxr of t xeaises to he 
assessed in each cell was determined In the relatiu weights, and a view and selection were 
done by cells* 

After the initial objectives matrix was developed, an advisor) board was formed tijgivc di- 
. reaction and advice to the National Assessment staff for further afinement of the objectives 
and the development of the assessment. The six-member advisor) board included three 
univcrsit) mathemafics educators, two mathematicians and a mathematics teacher. This 
, board was instnrmental in organizing the final set of objective*, planning the development 
of exercise's, selecting the final exercises and planning the subsequent reports. 

o 
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FIGURE i . Objectives Framework for the Second Assessment 
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The first task of the advisor) hoard was to review tht new objectives matrix and put it into 
final form.' The board and NALP staff thought the objectives should be used as a plan or 
framework for exercise development and for reporting. The) thought a reporting scheme 
should exist prior to excai.se devtiopmen* to help organize and improve the comprehen- 
siveness of trw second assessment. The advisor) board devised a set of questions that re- 
lated to each of tlu four cognitive processes (knov\ ledge, skill, understanding and applica- 
tion) described m Chapter 3. For example, under mathematical skills, one of the questions 
was u How well can students perform computation?" Under mathematical applications, 
one of the questions was "How well can students solve typical textbook problems'" Each 
series of questions was intended to be "answered" by the results from the assessment of a 
set of f exercises. This planning helped insure that the questions could be adequately cov- 
ered b) the assessment. These questions and more detailed information on the objectives 
appear jn Mathematics Objectives, Second Assessment (1978). 

While the objectives were being formulated, conferences were held to discuss special top* 
ics reflecting current trends in mathematics education. A special topic that received con- 
siderable attention was the measurement of attitudes toward mathematics. Attitudes were 
not measured during the first mathematics assessment because of the difficulty of develop- 
ing adequate exercises. However, consultants for the second assessment encouraged the 
development of attitudinal exeaises, and an effort was made to develop such measures. 



Assessment Results and Reports 



Approximate!) oi.e- third of the exercises from the second assessment were released, man) 
of them appearing as examples in four reports on the results of the second assessment. The 
reports, reflecting the objectives matrix, arc Mathematical Knowledge and Skills (1979), Mathe- 
matical Understanding (1979) and Mathematical Applications (1979). A fourth report, Changes in 
Mathematical Achie\emcnt f 1973-78 (1979), discusses the changes in mathematical achieve- 
ment during the five years between the first and second assessments. 

The text of each released exercise and accompanying documentation including selected re- 
sults can be found in The Second Assessment of Mathematics, 197/-7& Released Exercise Set 
(1979). Summary data augmenting "the four selected reports mentioned above appear in 
Mathematics Technical Report. Summary Volume (1980). This report includes information on 
mean performance levels on various sets of items for the nation and various population 
subgroups. A detailed description of the developmental pruii.*, sampling, data collection, 
scoring and data anal) sis can be found in Procedural Handbook. I9JJ-J8 Mathematics Assess- 
ment { (980). Fur researchers who art interested in doing further anal)ses of the assessment 
data, data tapes containing respondent-level data for all exercises in the second assessment 
*are available. 1 

Jn addition to the reports produced b\ National Assessment, interpretive articles aimed 
primarily at teachers were written b) a panel of mathematics educators from the National 
Council of T a. hers of Mathematics (NCTM). The NCTM panel presented summaries of 
its findings .in t[n April iy8o issue of The Arithmetic Teacher and the Mav iy8o issue of The 
Mathematics Tcachc;. Succeeding issues contain brief articles on specific topics, suggesting 
vva)s mathematics teachers might use the implications e>f the results in their teaching. 
Titles of the se article s appear in the re fcrences listed at the back of this booklet. 



'Data tapcN an a\a}|al>K . at a 1 haigi . through tlu IX partrm M of List r Struts. National Wssrm nt of I <liua- 
tiopal IVogivss, Sinn* 700. i8f>o Lincoln Stnvt. iVrmT, Colorado 8029$ 
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CHAPTER j • 

THE THIRD ASSESSMENT 
OF MATHEMATICS (1981-82) 

The development of the objectives and assessim nt c xe re isc s proc ee de'd along lines dc sc rilxnl 
in Chapter 2. College or wmerMt) mathematics educators, mathematicians,* classroom 
teachers and interested la> citi/ens contributed their views to the development of objec- 
tives and assessment exercises. A nine -member advisor) committee was instrumental :,i 
reviewing the objectives and giving guidance throughout the deulupmontal process A list 
of the advisjr) board members and consultants who aided the developmental process ap- 
pears in Appendix A. 

The objectives for tin third mathematics assessment arc based on tin framework used for 
the second assessment with some revisions that reflect current content and trends in 
school mathematics. To upilate tin c)bjcctius, numerous mathematicians and matin mat- 
its educators reviewed tin se-tomLasseshnunt objectives and made suggestions fe>r revi- 
sions and new content. " ~~ 

The objectives framework uses a two-dimensional eontent-ln-proci ss matrixTor organiz- 
ing the objectives (sec hgurc 2). One dimension includes live process K vcls and the other 
dimension me hides six content areas. Attitudes toward mathematics, abilitx to usc< the cal- 
culator and computer litcrac) (which were considered "special topics" in tin last assess- 
ment) have been incor|X)rated into the matrix for the third assessnn-M 



Content 

The content domain for tin third a^sMmnt oi mathematics draws primarily from the 
current curriculum of e lc me ntarj ^nej^su^ndar) schools, although some projection of 
future mathematics emphases is acknemlcdgcd (for example, a,s.sc ssmc nt of problem soK- 
ing strategies, use uf calculators and computers). Mathematics up to, but not indeiding, 
calculus is included in the assessment exercises, which are classified according to the six 
content categories show n in Figure 2. 

These content categories help to organi/e the domain, bu^arc nejt intcnel d to be repre- 
sented equally in the assessment. Each is discussed below.- 

9 



v FIGURE 2. Objectives Framework for the Third Assessment 
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I. Mathematical 

knowledge 

II. ' Mathematical 

skill 

III. Mathematical 

understanding 
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IV. Mathematical 

' - application and 
problem solving 

V. Attitudes 
toward 
mathematics 



Numbers and Numeration 

This category ton tains tlu la i got number of exert ises bet a use of its importance in the 
curriculum. txercises dial with the wajs numbers are used, processed or written. Knowl- 
edge and understanding of numeration and number concepts are assessed for whole num- 
bers, common fractions, decimal fractions, integers and percents. Considerable emphasis is 
placed on operations. Number properties and order ablations are also included. Most of the 
exercises included here arc to be done with paper and pencil,* however, In some instances, 
students are asked to use other computational methods such as mental computation or 
estimation. Lxeruses include typical one- and two-step applicatiofi r problems, nonroutine 
problems and consumer problems. Nonroutine problems are exerci/es not normal I j taught 
or, encountered in the curriculum, but understandable to the age group. Consumer prob- 
lems deal primarilj with the uses of mathematics in commercial situations (for example, 
the mathematics needed for bu)ing and selling, including loans, percerft/discoun^, finance 



charge and reading advertisements) and arc emphasized more at the 17-year-old level than 
at the two" younger age levels. 

An important new assessment category within numbers and numeration'^' estimation. 
Thea* is an imreasing need for students to be able to make good estimates. With the wide- 
spread use of the calculator, students need to be able to check the reasonableness of their 
answer by estimating. As consumers, the) face daily decisions aquiring estimation skills. 
Two types of estimation skills are assessed, computational estimation (which mvoUes 
working with numerical data alone) and application estimation (which requires working 
with numerical data embedded in a aal-world context). 

To encourage students to estimate rather than use paper and pencil, on!) a few .seconds aa 
allowed to complete each excaisc. Additional information on the assessment uf estimation 
is included in Appendix B. 



Variables and Relationships 

The use of variables and alationships corresponds to an important part of the school 
mathematics curriculum. The cxvaiscs Messing skills in this aaa deal *\ith the acogni- 
tion of facts, definitions and symbols of algibra, the solution of equations and inequalities, 
the use of \anablis to repnsent prubkm situatioas and elements of a number system, the 
c\aluatiqn and interpretation of functions and formulas, tk graphing of points and lino in 
a coordinate system, the usi of exponential and trigonometric functions, and logic. Thca 
aa ury few cXcaiscs appropriate for 9 uar-olds in this category and only a ft w topics aa 
appropriate for 1 ear-olds. Houcur, most exe'aises aa appropriate at the 17 -year-old 
level, whea* students ha\e had the opportunity to study algebra. 



Shape, Size and Position 

The iXtaises in this contmt catcgon measua objcctiws a lau d to school geometry. The 
emphasis in the assessment is not on geometry as a formal, eleductiu system. Rather, the 
exercises concern plane and .solid shapes, cejngrucnce t similarity, properties of triangles, 
paipcrties of quatlnlaterals, constructions, sections of solids, basic theoams and alation- 
ship, and rotations and sy mm etrv. 



Measurement 

Th<* measuamcnt exercises co\er appropriate units, ec]ui\alence alations, instrument" 
reading, length, weight, capacity, time and temperature, perimeter, aaa and \olume, non- 
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stanUan! units, ami paxision and interpolation. A substantial number of the measurement 
exercises require the use and understanding of metric units. 

* * 
'Probability and Statistics 

This content area reflects a greater emphasis on statistics and probability in the school 
mathematics curriculum v The exercises assess collecting data; organizing data with tables, 
^charts, graphs, interpreting and analyzing data, draw ing inferences, making generalizations; 
using basic statistic^prcdicting outcomes and determining combinations. 

Technology 

The impact of new technology on school mathematics Is measured in this content area by 
assessing the use of the calculator and computer literacy. 

Calculator ^ 

• 

The increaMnj* a\ailabilit\.and popularity of calculators has made it important for National 
Assessment to gather information on their use bv .students. This was begun in the 1977*7** 
mathematics assessment. 

Five categories of e.wa^cs arc identified for assessment. The) aa (i) routine computa- 
tion, (2) moa difficult computations. ($) undi rstanding concepts, {4) exploration and (5) 
application pmblcm .solving. Some calculator activities such as understanding and explo- 
ration aa more appropriate for instructional use in "the classroom and are not emphasized 
in the assessment. Thus, of the five categories of exeaisc^, computation, nonroutine com- 
putation and application aa measured in the gaatcst depth, ^dditional information on 
these categories can be found in Appendix B. 

#■ 

Computer Literacy 

An increasing number of schools have computers or computer terminals available for stu- 
dents' use. Tlus led National Assessment to begin colleeting computer literae) data in the 
1977-7^ mathematics assessment. O 

Thirte-en- and 1 ;-)e ar-olds aa asked to provide background information on thejr experi- 
ences with computers, whether the) have access to one in their school, what programming 
language and computer topics the) have. studied and what specific activities and problems 



£ . " they ha\e sobed using a computet The assessment of computer litcrac) includes measures 
I/* ' of students* attitudes toward the uses, effect and role of computers and their knowledge of 
specific terms, flow charts or BASIC programs to determine the output. % 

A suinman outline of then content categories is prowded in Appendix C. The desired 
approximate percentages e>f exercises bj content category and age group aR shown in 
Figure 3. " * 

FIGURE 3, Percentages of Exercises by Age and Content* 
Age 9 Age 13 Age 17 



A. Number^ and 40% 40% - j$% 
numeration 

B. Variables and 10 10 20 
relationships 

Shape, size and ' 10 10 10 

position 

D. Measurement ic ic 10 

U t J ' ' "j h. Probability and $ e; 10 

statistics 

K Technology 10 10 10 

*Thcsc yrcntaget do not add to 100% because the attmtdmal c xeroses are 
not included. 



Process 

Thi process domain for tin third assessment has flu categerries, as shown in hguri 4. 

Like the content domain, the prociss domain can In used to classify either objextius of 

mathematics instruction or e xe rcises to asse ss the K arning of mathe mattes. Although e acb 

categor) suggests a t)pe of mental process, neither objectius nor exercises falls math into 

a sjugle process category — if only because the process has to be infe rred, and differe nt 

students may use different proc esses e>r differe nt combinatie>ns of processes. Arbitrary deci- 

sioas must be matle in using am svsteiti of process categories. Such a svstem is helpfid, 
Q 44 ' 




pf 9*. diversity possible within a given content " 



^;/;^thematica^ Know! 



^ Mathematical knquledge Refers to the recall and recognition of mathematical ideas exr 
HV> pa^ ; d^ ,\\ords v symbojs o| figures. Mathematical knowledge relies» for the most part, on 
^ ^jij^mpTy .processes. Ijt. do^^. not ^ordinarily require any other more complex mental; 



■rs 



.processes. 



FIGURE 4» Perceittages of Exercises by Age and Process level 
Age 9 Age. 13 Age 17 
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Exercises that assess mathematical knowledge require that a student recall or recognize one 
or mar items of information. An example of an exercise involving recall w ould be one that 
asks for a multiplication fact such as the product o'f five and two. Another example would 
be an exercise asking for the statement of a mathematical relationship such as tftgjftw of 
cosines. An example of an exercise involving recognition would-be one that presents sev- 
eral symbols and asks which symbol means "parallel.* 



Mathematical Skill 



t. Mathematical skill refers to the routine manipulation of mathematical ideas and relit s on 
-algorithmic processes that are standard procedures leading to answers. Exercises assessing 
£• mathematical skill assume that the required algorithm has been learned and practiced, 
f 7 Thcv do not require that the student decide which algorithm to use or that he or she apply 

!erj[c 



the algorithm to a new situation. Such exercises aim at measurihg'proficiency in carrying 
\ out the algorithm rather than understanding how or why it works. Mathematical skill is 
assessed by exercises that require the performance of specified tasks, such as making mea- 
surements, multiplying two fractions, performing mental computations,.graphing a linear 
. equation or reading a table. _ 

¥ 

9 

* 

Mathematical Understanding 

Mathematical understanding refers to the vxplanation and interpretation of mathematical 
knowledge and relies primarily on translation processes. The mathematical knowledge can 
be expressed in words, symbols or figures; and the translation may be within or between 
any of these modes of expression. Mathematical understanding involves memory processes." 
of associating one item of knowledge with another. * 

Mathematical understanding may also require judgments selecting the appropriate uses of 
different tools or processes. For example, students should understand appropriate times to 
use a calculator, computer, estimation or paper-and-pencil computation. 

Exercises that assess mathematical understanding require that a student provide an expla- 
nation, an illustration for one or m re ileus of know ledge or the transformation of knowl- 
edge. They do not require the application of that knowledge to the solution of a problem. 
An example-of an exercise involving explanation is one that asks vv hy a«ertain graph is not 
the graph of the funuion. Exeaises involving transformation might ask for a drawing of an 
array to represent six times seven or ask for an equation to represent the information in a 
word problem. 

Mathematical Application 
" and Problem Solving ~~ 

Mathematical application and problem solving refer to theu* of mathematical knowledge 
rial and understanding in solving both routine and nonroutine problems. Mathematical 
application and problem solving rely on memory and algorithmic, translative and judgmen- 
tal processes. The student is „„, , 0 ld how to solve the problem; reasoning and decision- 
makmg. processes must be used. 

Exercises that assess mathematical application and problem solving require a sequence of 
•processes that relate to the formulation, solution and interpretation of problems The pro- 
cesses may include availing and recording knowledge, selecting and carrying out algo- 
rithms, making and testing conjectures, and evaluating arguments and results. 

Wises assessing mathematical application may vary from routine textbook problems to 



^exercises dealing .with mathematical arguments. An exercise might requia- the solution of a 
standard problem or proportion, the demonstration .that two geometric- figua-s are con- 
gruent, an estimate of the amount of carpet needed fos a room, or the formulation of a 
•problem, given a graph of statistical data. 

Exercises assessing problem solving require the use of strategies in solving nonroutine 
problems. Students may need to be- able to use such strategies as drawing diagrams tnal 
ind error, modeling, simplification and estimation in older to correctly solve the problems. 



-Attitudes Toward • „ 

^Mathematics ' 

.* > National Assessment assessed attitudes toward mathematics'for the first time .luring the 
" second assessment in .977-78, arid these exercises are reassessed in the third mathematics 
■"" . assessment. Five categories of attitudinal measures were developed: (.) mathemat.es n 
school (2) mathematics and oneself, (3) mathematics and society, (4) mathemat.es as a dis- 
cipline and (c) attitudes toward computers. These categories were not developed a" «w 
' but rather as sets of exeaises with related content. Additional information on the assess- 
ment of attitudes appears in Appendix B. - 

- The desired approximate peRcntage.^of exercises by age group and process category are 

• " shown in Figure 4. 

Questions To Be Answered 
bv the Assessment 

-. • 

In the development and selecUon of exercises for. the assessment, can- was taken to assure 
an appmpriate balance of emphasis on l>oth,the content and process dimens.ons. Achieve- 
ment of this balance was facilitated by a set of questions organized accord.ng to the cate- 
. ' gories of the process dimension. The questions were based on the combined pr.ont.es o 
the inierestefl public, mathematicians, mathematics educators (including teachers) and 
educational administrators. 

. I. Mathematical knowledge 

■ / A. How well can students recall and recognize facts, definitions and symbols? 

* * i, 

L' H. Mathematical skill 

t\ " A . How well can students perform papcr-and-pencil computations, including 

... « 
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computations with whole numbers, integers, fractions, decimals, percents, 
arid-ratios and proportions? 
B» How* w ell can students perform algebraic manipulations? 

C. How well can students perform geometric manipulations like constructions 
and spatial visualizations? 

D. How well can studerits make measurements? 

E. How* well can students read graphs and tables? 

E Ho\\ well can students compute statistics, probabilities or combinations? 

G. How well can students perform mental computations, including computation 
with whole numbers, fractions, decimals and percents? 

H. How well can students estimate the answers to computations and 
measurements? 

I. How well can students perform computations in\ol\ing whole numbers, 
decimals, fractions and percents using calculators? 

J. How well can students read flow charts or basic computer programs?.. 

Mathematical understanding * 
• * 

A. How well can students translate a \crbal statement into symbols or a figure, 
and vice versa? 

B. How" well do students understand mathematical concepts and principles? 

C. How well can students select the appropriate uses of -computers? 

D How well can students select an appropriate computational method such as 
paper and pencil, mental, estimation or calculator? 

Mathematical application 

A. How well can students solve routine textlxnok problems? 

B. j How well can students solve nonroutine problems? 

C' How* well can students apply problem-solving strategies? 

D. How well can students estimate the answers to application problems?, 
h. How well can students interpret data anil draw conclusions? 

F How well can students use mathematics, including logic, in reasoning and 

making judgments? 
G. How well can students use a calculator to sol\e application problems? 

Attitudes 

A. How do /udents feel about the mathematics they encounter in school? 

B. How do students feel about the \arious activities in mathematics classes? 

C. How do students feel about their personal experience with mathematics? 

D. What are students* beliefs about the nature of mathematics as a discipline? 



% * . \ " What arc students' beiufs about the value of mathematics to society? 

E What aiv students' beliefs about computers? 



The development and selection of exercises is pHmarily oigaiuzed around these questions, 
1 which expmss the main objecting of the" third mathematics assessment and will serve to 
organize the reports of assessment results. 



r- 



*To answer these questions as comprehenshely as possible, sets of related or "nested" exe 
cises appear in the assessment. For example, the same numbers may be used in a computa- 
tional exercise and in an application exercise, or identical data may be provided in several 
different formats, or an intermediate step in a multistep problem may be assessed sepa- 
rately in another exercise. Nested exercises are an attempt to identify tho mathematical 
processes that cause students difficulty. 
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APPENDIX B 



• DETAILS OF OBJECTIVES FOR THE 
THIRD MATHEMATICS ASSESSMENT 



For the interested reader, more information is provided here on certain assessment topics 
in the third assessment. Topics include assessment of attitudes, the tabulator and estima- 
tion skills. 



Attitudes 

The attitudinal measures included in the third assessment were originall) developed for the 
second assessment and will be reassessed to provide information on changes in students* 
attitudes. l ive categories of attitudinal measures w ere developed. 

The first category, mathematics in school, consists of exercises assessing attitudes toward 
the mathematics courses students ha\e countered in school. Subcategories of exercises 
include a school subject comparison, questions about the frequency of \ario^s classroom 
activities and students' attitudes toward those actiwties, and a breakdown uf mathematics 
content activities. 

The subject-comparison exercises list the most commonl) encountered school subjects 
(e g , science, mathematics, social studies) and ask respondents to rate each subject on the 
basis of whether they like or dislike it, whether they find it easy or hard and whether or 
not they view it as important. 

Students are presented with a list of actiwties that might occur in a mathematics classroom 
and are asked to indicate how often (often, sometimes, ne\er) the) ha\e participated in 
such activities. They are also asked to state whether they like or dislike each acti%ity and 
whether they find the acthity useful in helping them learn mathematics. Typical exercises 
are the following: * 
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if - ' Last year in your mattarnaticrcourse how often did you 





x +x ntr-U tUo t<»ac Kit work mathematics problems bn the board? 

f\ t ^\JltIl \f\V IvdHW* »* vj» r* illume miu»i^»' | v 






Often Sometimes 

* * 


Never 




p— V, 

u *n»t indivtdinl hch> from the teacher on your mathematics? 




f 


Often Sometimes 


Never 

* 




£. help a classmate do mathematics? 






'Often ' Sometimes 

o <=> 


Ncser 

o 



Hou do >ou feel about each of these activities m learning mathematics? First, hou much do 
you like or dislike them? Second, hou useful are the; in learning mathematics? Indicate your 
fcclingby filling in one oval on each line. 



A. Taking mathematics tests 








Like A Lot 


Like 
<D 


Undecided 


Dislike 

o 


^ Dislike 
A Lot 

> 


* A'ery Useful 

o 


Useful 

o 


Undecided 


Not Very 
Useful' 

o 


Useless 

o 


B. Doini* mathematics homework 








> 

Like A U>t 

CD 


Like 


Undecided 


Dislike 

o 


Dislike 
* A Lit 
<Z> 


Very Useful 


Useful 

o 


Undecked 

o 


Not Very 
Useful' 
<=> 


Useiess 



Respondents an? also given a list of content activities and asked to respond on an impor- 
tant/not-important, easy/hard, like/dislike basis. A sample exercise is: 

How do you fed about each'of these mathematics activities? First, how important arc 
they? Second, how easy are the)? Third, how much do you like them? Indicate \our 
feeling by tilling in one o%aI on each line. 



% 


' A. 


living word problems 

Very* Important * 
% Imponant 

<=> <b 


Undecided 


Not Vcrv 
Important 


Not Important 
At All . 

o 




- 


Vcrv Kasv 

CD 


has\ 


Undecided 

<=> 


Han! 


Very f lard 






Like It 
A Lot 

o 


Like It ■ 


Undecided 


IXslifcc It 


Dislike It 
A Lot 




B. 


Working \\ ith fractions 




* 








Wry 
Important 


Important 

o 


Undecided 


Not Very 
Important 


Not Important 
At AH 






> Vcrv bas\ 
<=> 


hasv 


Undecided 


Hani 


\er\ Hani 

o> 






Like It 
A Lot 
<Z> 


Like It 


Undrc ided 


Dislike It 


Dislike It 
A lot 




C 


Estimating answers to problems 

Very Important 
Important 


Undecided 


Not Vcrv 
Important 

<z> 


*'*H iiniKiriuni 

At AH 

o 






Vcrv Kasv 

• o ' 


has'v 
<=> 


Undccidrd 


* Hard 
<=> 


Vcrv Hani 

<o 






Like It 
A Lot 

■* 


Like It 


Undecided 


Dislike It 


Dislike It 
A Lot 

o 
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:&kise$mithin the -mathematics and oneself" category- assess a respondent's perception 
pf-himself or herself in relation to mathematics. Different attitudinal components such as 
anxiety, motivation, self-concept and enjoyment of mathematics arc reflected in these 
Ukcrt-type exercises. A sample exercise follows: ^ y 

* * * 

This exercise asks how vou feel about mathematics or mathematics activities. There are no 
- correct ansuers. The answer choices are "True about me." "Sometimes true dbout me" and 
-"Not true about me." For each part, choose the one response that best describes how vou Feel 



1 , 


" Mathematics is boring for mo. 


» 






-True About 
Me ' 


jSometimesTrue 
About Me 

o 


Not True 
About Me r 


B. 


! usually understand what ue aa- talking about in mathematics. 






True About 
• Me V 


Sometimes True 
About Me 


Not True 
About Me 


C 


Doing mathematics makes me nervous. 






True About 
Me 


Sometimes True 
About Me- 


Not True 
About* Me 



The four examples above arc for 9 -year-olds. "For , 3- and , 7 -yca,olds,-the exercises ha W 
five response opticas, from "Strongly Disagree" to "Strongly Agree." 

The "mathematics and society" category reflects two major concerns: the'value of mathe- 
matics to the indindual as a member of society and the value of mathematics to society ,n 
general. Likcrt-typc exercises are designed to assess attitudes toward both the usefulness 
and importance of mathematics to society. A typical exercise follows: 

This exercise asks ho« you fee l about mathematics or mathematics activities. There are no 
correct answers. The answer choices are "Strongly Disagree." "Disagree." "Undeaded. 
"Agree" or "Strongly Agree." For each part, choose the one response that b«t describes how 
jou feel about the statement. Be sure to fill in one oval in each box. 



A. Most people do not use mathematics in their jobs. 

* 

Strongly Disagree Undecided Agree Strongly 

^ ' -> AgrJe 

o o o o o 



B. J would like to w ork at a job that lets me use mathematics. 

Strongly Disagree Undecided Agree Strongly 



Disagree 

O C5 o 



Agreed 



V 

Attitudes toward mathematics as a field of study are- the focus of the exercises in the 
mathematics as a discipline" category. Students' views toward mathematics as a cumula- 
tive or compartmentalized subject, the status of mathematics as a fixed or changing subject 
5md mathematics as a process are among the different aspects of attitude assessed in this 
category. Items such as the following are included: 

this excroV ask* hou you feci about mathematics or mathematics activities. Then- are no 
r W »* a ™ e choi «* an- "Strongly Disagree." "Disagree," "Undecided." 

r , f T 5 y grCt " F ° r Cach P^hoose the one respond that best describes how 
jou feel about the statement. Ik- sure to fill in one-oval in each box. 



A. Mathematics is made up of unrelated topics. 

t . 




# 


Strongly Disagae Undecided 
Disagree 

O <p o 


.Agree 

o 


Strongly 
Agree 


8. Mathematics help* one to think logically. 






Strongly Disagree Undecided 
Disagree w. 


Agree 

* 


Strongly 
Agree 


C- Doing mathematics requires lots of practice in foil 


owing rules. 




Strongly Disagree Undecided 
Disagree 


Agree 


Strongly 
Agree 



* ' Calculator 

like the assessment of attitudes, assessment ofche use of the calculator was first <lbne>dur : ■ 
Wthe second mathematics assessment. At that time the increasing availability and popu- 
larity of calculators made it important for National As .ssment to collect informal on - 
-.their use by students. The small, inexpensive calculator has the potential to dramat.cally 
influence the mathematics curriculum in the United States. m . 

Several conferences wen, organized by Nationar Assessment to discuss the place of the cal- ^ 
culator in-the'second mathematics assessment. The participants at these. conferences .den- . 
tified five categories.of exercises for « hich calculators might be used. These categories are: 

, ' Rm Compaq - This category includes typical computations with whole 
-° numbers, decimals, fractions and integers that arc routinely taught at a particular ■ 
age. 

, Merc D,fficuk Colons - Students might be- asked to perform difficult computa- 
tions or computations for which algorithms have not been formally tfcgta. hot 
■ example, 9-year-olds might be asked to do computations « ith decimals or d.fficult 
division problems. Thirteen-year-olds might be given chaining operates or 
convcrsions between fractions and decimals. Students at all ages might be requ.red 
to work ^ ith very large numbers or complicated decimals that would make compu- 
tation without a calculator tedious. 

'Underact Concepts - Nine-year-olds might use the calculator to learn more 
' about place value, and ■ j-year-olds might learn estimation for- order of magnjUuk. 
Seventeen-year-olds might use the calculator to facilitate learning order of opera- 
tic approximating square mots, graphing functions and understanding properties 
of functions. 0 

Etpkra,** - bxercisvs in this category might deal *kh topics in number theory 
including series, summations, patterns or divisibility problems. 

Laum and Mem Solmg - This category includes routine and more dimeujt 
»«d problems an<l also multistep problems. For 9 -year-olds, some problems might 
use larger numbers than they are accustomed to working with. Thirty-year-olds 
might work problems involving percent, unit pricing and other more d.fficult nod 
problem.;. Seventeen-year-olds might be given a variety of realistic consumer prob- 
lems as well as exercises dealing with mathematical formulas. 

In an effort to collect data on the use of the calculator, as wide a variety of topics as possi- 
0 "e was assessed. Although it «as agreed that the five categories should be assessed at each 
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ofjth$r three .age , groups, . practical; considerations imjxwed limitations , on \vhat could be 
assessed: Some activities using the calculator (especially understanding and exploration ex- 
ercises) are; more appropriate for instructional use in the classroom than for an assessment. 
Thus, of the five categories of exercises, categories 1, 2 and c were measured in the greatest 
<deptH:. 

pheHest Booklet comprising approximate!) 20 exeaises designed for calculator usage was 
administered at each. age: Students were required to use a simple four-function calculator 

Vafter being given a minimal amount of instruction on how the calculator is used; These ex- 
ercises are difficult .or too time-consuming without a calculator. -Many of the exercises in 
each calculator test booklet appeared again in another booklet for the same age group. This 

'allowed comparisons of performance uith and w ithout the calculator. 

Each student answered background questions regarding his or her experience with calcula- 
tors. These background questions asked how often the student has used a calculator,, if the 
student's family owns one, in what school classes the student has used a calculator and 
what experiences with calculators outside of school the student has had. 

Estimation 

+ \ - - — — *- - * 

Estimation lias long been recognized as an important mathematical .skill. The widespread 
use and a\ailabilit) of calculators places additional importance on computational estima- 
tion skills. Because it is eas) to make a ke) -stroking error when using a calculator, students 
need to be able* to estimate the magnitude of an answer or acogni/e the reasonableness of 
asults. 

> 

Two tjpes of estimation skills arc assessed, computation estimation (which involves work- 
ing with numerical data alone) and application estimation (which requires working with 
numerical data embedded in a real-world context). The paaquisitc .skill of mental compu- 
tation of exact answers is also assessed. 

Most estimation exercises included in the assessment aquire estimates using whole num- 
bers, but some exeaises include decimals and fractions. The four operations (addition, 
subtraction, multiplication and division) arc a patented, and several problems require 
know ledge of peaent. . 

Both open-ended and multiple-choice exercises a a assessed. For open-ended exeaises, 
scoring guides indicating acceptable response ranges ha\c been constructed. Generally, 
three categories of asponses aa considered acceptable. (1) ex&ct answers, (2) \ery close, 
jestjmates and (3) reasonable estimates. The intervals for >hese guides wea determined by 
analyzing field-test asults, 1 
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2> I jdon't kho>>> 



Estimate . 



{' ; . Sample exercises for application estimation are: 



ABOUT HOW MUCH 
WILL 17 RADIOS 
COST? 












00 







Estimate . 



;erlc 



33 

3<> 



<^> .280 

o 

I don't know. ^ 

• • * 

An effort will be made to relate the arithmetic required in the mental computation exer- 
cises with the arithmetic needed in the computation and application estimation exercises. 
For example, a mental computation exercise might be 20 x 40. The related computation 
estimation exercise might be 19 x 42, which the student would probably solve by rounding 
each, number to the nearest 10. A related application estimation exercise might ask stu- 
dents to estimate the area of a rectangle with a width of 19 and a length of 42-By embed- 
ding related or identical numbers in different types of problems, more information can be 
obtained on students' estimation skills. 



APPENDIX C 
CONTENT OUTLINE 

.iNumbgre and Numeration . 

\ - ' * - ^ 

i. * Nu )" cr ation (whole nUmk-rs/fw 

notation) . p 
1. Number concepts (whole numbers, fractions, decimals, percent, integers) 
3. * Operations (whole numbers, fractions, decimals, percents, integers) 
4* .Mental computation 
£. Estimation 
6. Pnoperties 
7* Relations 
Variables and Relationships 

1 . Facts, definitions and symbols 

* V 

2. Use of variables in equations and inequalities (solutions, equivalences anil 
translations) 

3. Operations with variables 

4. " Use of variables to represent elements of a number system 

a Functions and formulas * 
6. Coordinate systems 



7/ * '&^%ntia|;and trigonon^trlcfunctioris- % f 



A - • 



• 8. logic - * \ ' 

G; Shape, Size and Position 

i, Reaction of figures 
.2. Constructions and drawings 

* . 3. s Visualization^ (static and dynamic) 

4. Recognition of relationships (congruence, similarity and symmetry) 

5 . identification of properties from given visual information within, between or 
among figures 

. ■ 6. Relationship involving classes of figures 

" 7. Definitions, postulates and theorems (recall, inference and application) 

D. Measurement j 

,. U Unit (appropriate size and type of unit, unit equivalents, conversions within a 
system) 

2. > Instrument reading (English and metric rulers, scales, thermometers/ clocks, 

etc.) 

/ 
/ 

3. Linear measure (including nonstandard units) 

4. Area, perimeter and volume 
c. Precision 

6. Estimation of measurements 



-.*."..- .E. Probability and Statistics #< 

* . ,. ' Organizing, displaying and interpreting information (tallies, graphs, charts 



4 and tables) 



lERJCV, ^ . 



t: Measures of central tendency (mean, median, mode) 

3. Measures of spread and position (range, percentile, standard deviation) 

4. Sampling and polling 

Probability, (simple^ compound and independent events; odds) 
6. Combinations and permutations 

i 

Technology ^_ 



1. Hand 'calculator 

2. Computer literacy 
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